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METHOD FOR DIGITALLY RENDERING AN OBJECT USING MEASURED BRDF 

DATA 

CROSS-REFERENCE TO RELATED APPLICATION 

5 This application claims priority pursuant to 35 U.S.C. § 1 19(e) to U.S. Provisional 

Application Number 60/426,560, filed November 15, 2002, which application is 
specifically incorporated herein, in its entirety, by reference. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

10 The present invention relates to methods in the field of digital imaging, and more 

particularly, to methods for computer-assisted shading and rendering of three- 
dimensional surfaces. 

2. Description of Related Art 

A core aspect of computer-assisted rendering involves calculating reflected light 
15 rays resulting from a defined modeled light source, based on the surface geometry of an 
object to be rendered, and the reflectance properties of its surface such as may be 
caused by surface properties at a microscopic scale. Traditionally, fairly simple 
theoretical models, such as the Phong model, have been used to model microscopic 
reflectance properties. But many common materials, such as fabrics, cannot be 
20 rendered in a photo-realistic way using simplified models. 

A more sophisticated approach to modeling reflectance properties entails the use 
a function that defines reflectance as a function of the angle of incidence and angle of 
reflectance. This function is usually referred to as the Bidirectional Reflectance 
Distribution Function (BRDF), which may be expressed as 
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where E is the irradiance (incident flux) and L is the reflected radiance (reflected flux). 
The angle of incidence is defined by 0 i J i , and the angle of reflectance by G r ,<f> r . The 
symbols 6 and § here represent angular coordinates, for example, as used in a polar 
coordinate system. The BRDF may be generally described as a function that defines 
5 the light that will be reflected in every direction from a surface, for each incident ray 
angle. The BRDF ratio p(0„$,0 r ,£) for a defined pair of incident and reflected rays is 
referred to herein as a "BRDF value." Materials that exhibit anisotropic reflectance, 
such as fabrics, are difficult to model theoretically. Sufficiently accurate theoretical 
models generally are not capable of sufficiently photo-realistic rendering in demanding 

10 environments, such as motion-picture production, particularly for applications that 
require seamless compositing of digitally rendered and photographic images. 

As an alternative to modeling a surface's BRDF, a sample of actual material may 
be measured using a measuring apparatus. Various measuring apparatus are known in 
the art, including physical gonioreflectometers and imaging gonioreflectometers. For 

15 rendering applications, using measured BRDF data is subject to several limitations. For 
one, traditional measurement apparatus often does not yield reliable or reproducible 
BRDF measurements. Thus, the final rendered result may differ noticeably from a 
photographic image of the same material. One of the reasons for photo-realistic 
rendering is to provide digitally rendered images that can be seamlessly inserted into 

20 photographic images, for the purpose of creating digital special effects. Inaccurate 
rendering of a material, such as may be caused by insufficiently precise measurement 
of the material's BRDF, will inevitably frustrate this purpose. 

Second, even if sufficiently accurate BRDF data can be gathered using a 
carefully designed reflectometer, the data will only be sampled over a discrete number 

25 of points of a sample surface. Because the collection of BRDF data for each point of 
the sample surface is inherently time-consuming, available BRDF data for a given 
material tends to comprise a sparsely-sampled data set. Merely interpolating between 
sparsely-sampled data points may not provide a sufficiently accurate model of the 
actual BRDF to achieve a photo-realistic result. 
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These limitations have hindered the application of photo-realistic rendering, 
particularly for demanding production environments such as motion picture production. 
It is desirable, therefore, to provide a method for overcoming them. 



SUMMARY OF THE INVENTION 
5 The present invention provides methods for photo-realistic rendering using 

measured BRDF data, that overcomes the limitations of the prior art. The method has 
proven capable of providing photo-realistic digital images in a motion picture production 
environment. Images rendered according to the invention were virtually 
indistinguishable from photographic images of the same material, even when 

10 incorporating previously difficult-to-render anisotropic materials such as fabric. It should 
be appreciated, however, that photo-realistic results may not be obtained for every 
conceivable material using BRDF sampling and rendering according to the invention. 
Some materials may be less amenable to this technique. Such materials may include, 
for example, living tissue, which is both extremely difficult or impossible to sample 

15 effectively, and may exhibit scattering and transmissive properties that are not 
adequately accounted for in the BRDF model. 

In an embodiment of the invention, the reflectance properties of materials are 
measured for use in digital rendering, characterized in terms of BRDF. The BRDF 
properties of desired materials are measured using a precision reflectometer with 

20 incident radiation from a laser source. Data may be sampled over a sparse selection of 
points that are not on a regular grid. Sample BRDF data may then be processed to 
remove outliers and resampled on a regular grid. 

Resampling may be accomplished by first constructing NURBS curves along the 
constant-azimuth raw samples. These curves may then be used to generate NURBS 

25 surfaces. A virtual ray may then be directed from the sample origin at various values of 

9 and comprising a regular grid. The intersection of the reflected ray with the 

constructed NURBS surface may be used to define the value of the BRDF for the given 

0, «j> of the incoming ray at the grid point of the reflected ray. This process may be 

repeated to define the BRDF for reflected rays over regular grid points, for each incident 
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ray sample point. The result will comprise an array or set of tables, each defining the 
reflected BRDF for a given incident angle over a regular grid. If the incident rays are 
collected over a sufficiently dense regular grid, then no further processing may be 
needed. In the alternative, a similar process may be used to resample the BRDF data 
5 over a regular and/or denser grid of incoming rays, by constructing NURBS curves for 
each reflected grid point over constant-azimuth values of incident radiation for a given 
reflected ray, constructing an incident-ray NURBS surface from the NURBS curves, and 
determining the corresponding BRDF value over a regular grid of incident rays from the 
intersection with the NURBS surface. 

10 The grid-sampled BRDF data may then be interpolated, such as by using fast 

quadrilinear interpolation lookup to generate BRDF values for arbitrary angles during a 
shading process. BRDF-rendered objects may be incorporated into scenes developed 
using an image-based lighting process, as further described in the copending 
application titled "REALITY-BASED LIGHT ENVIRONMENT FOR DIGITAL IMAGING 

15 IN MOTION PICTURES," filed November 17, 2003. Resulting digital images may be 
virtually indistinguishable from photographic images in the same frame, thereby opening 
up a new realm of possibilities for digital manipulation of real-life objects. 

A more complete understanding of the methods according to the present 
invention will be afforded to those skilled in the art, as well as a realization of additional 

20 advantages and objects thereof, by a consideration of the following detailed description 
of the preferred embodiment. Reference will be made to the appended sheets of 
drawings which will first be described briefly. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a flow chart showing exemplary steps for according to an embodiment of 
25 the invention. 

Fig. 2 is a diagram showing geometry useful for describing BRDF. 
Fig. 3 is a flow chart showing exemplary steps for determining BRDF values over 
a resampled grid. 
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Fig. 4A is a perspective diagram illustrating BRDF measurement data from a 
sampling grid for a fixed incident ray. 

Fig. 4B is a diagram showing geometry associated with constructing a curve 
using measured BRDF values over a section of a sampling grid. 
5 Figs. 5A and 5B are perspective diagrams showing exemplary BRDF surfaces for 

different incident rays. 

Fig. 6 is a flow chart showing exemplary steps for resampling BRDF 
measurement data to provide BRDF values over a denser and/or more regular grid of 
incident rays. 

10 Fig. 7 is a flow chart showing exemplary steps for interpolating resampled BRDF 

data during a shading process. 

Fig. 8 is a block diagram showing an exemplary system for carrying out steps of 
a method according to the invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

15 The present invention provides a method and system for digitally rendering an 

object using measured BRDF data, that overcomes the limitations of the prior art. In the 

detailed description than follows, like element numerals are used to denote like 

elements appearing in one or more of the figures. 

Exemplary steps of a method 100 for rendering an object using measured BRDF 

20 data are shown in Fig. 1. Initially, at step 102, a material to be rendered may be 

selected. Suitable materials may include, for example, fabrics of all types, foliage, stone 

and ceramic materials, brushed or textured metals, oxidized materials, powdery, dusty 

or dirty surfaces, and most other materials that are difficult to render using theoretical 

reflectance models. The material should present a surface with reflectance properties 

25 that are sufficiently stable for measurement. 

At step 104, BRDF values are gathered for the material over a grid of incident 

and reflected beam positions, such as by using a physical gonioreflectometer. Such 

measurement devices usually mount the sample on a flat rotating stage, and include a 

movable mount for an incident beam source and a separate movable mount for a 
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reflected beam detector. The general characteristics of such measurement 
reflectometers are known, but reflectometers as used for computer graphics 
applications have generally not been suitably equipped. Suitable equipment should 
include very precise and accurate mounts for positioning the light source and detector, a 
5 sensitive and well-characterized light detector, and a light source that is also very well 
characterized and controlled, such as a laser source with precision optics for controlling 
beam parameters. The reflectometer should also be capable of automatically and 
rapidly making a large number of BRDF measurements of a material sample. 

Suitable machines for measuring BRDF may be available from Surface Optics 

10 Corporation of San Diego, California, or from other suppliers. For example, Surface 
Optics SOC 200 Bidirectional Reflectometer comprises a suitable machine. Such 
machines have traditionally been used for engineering applications that required precise 
knowledge about the BRDF properties of materials, such as in aerospace, military, and 
optics fields. They may also prove useful for rendering purposes. Using such a 

15 machine, it is feasible to accurately measure the BRDF properties of a large number of 
materials, which may then be input into a BRDF database for rendering purposes. 
Previously, measurements of BRDF have been considered too unreliable to be useful, 
but photo-realistic results have been achieved by using BRDF's measured and applied 
as described herein. 

20 Advantageously, a laser source is used for the incident beam. A laser beam may 

be very well characterized as to wavelength and beam geometry. For example, a laser 
may be used to provide a collimated beam 212 that more closely approximates a 
theoretical incident ray 204, as shown in Fig. 2. In a reflectometer of this type, a sample 
202 may be mounted on platform in a defined coordinate space, indicated in Fig. 2 by 

25 the x, y, and z axes. Conceptually, a given BRDF value represents a ratio between an 
intensity of an incident ray 204 and a reflected ray 206, integrated over an infinitesimal 
solid angle. Each incident ray 204 is characterized by a pair of angular positions 0j, <|>i, 
and each reflected ray is characterized by 0 r , <|> r . The BRDF function is a four- 
dimensional function of these parameters. 
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A theoretical BRDF ray occupies a solid angle of an infinitesimal size, and 
converges to a point at the sample surface. But an actual physical beam must occupy a 
spot 208 of finite size at the material surface. In addition, if spot 208 is too small, the 
reflectance of the sample is determined by local microscopic sample geometry under 
the spot. This geometry may be highly variable, resulting in BRDF measurements that 
are not indicative of the macroscopic surface reflectance properties that are needed for 
most digital rendering. At the same time, the spot 208 size should be small enough to 
define the parameters 0j, with adequate precision. An optimal spot size should 
generally be the minimum size needed to encompass a representative area of the 
surface micro-geometry. This, in turn, will depend on the scale at which the material 
surface is patterned. For example, an optimal spot size for a tightly-woven fabric 
sample will be smaller than for a loosely-woven sample. 

The spot geometry and intensity profile should also be well defined. 
Advantageously, a laser beam can be reliably characterized as to its diameter 210 and 
intensity profile, so that the spot is well characterized. In addition, a laser beam is easily 
controlled to a range of diameters, so as to provide optimal spot sizes for a variety of 
sample materials. 

Using a suitable BRDF measuring device, measurements may proceed over a 
regular grid of incident and reflected rays. For each incident grid position, reflectance 
measurements may be made over a grid. For example, if the incident grid contains 100 
nodes, and 100 reflectance measurements are made for each incident node, a total of 
10,000 (100 2 ) BRDF values will be measured. Practical constraints limit the number of 
nodes that can be sampled, resulting in measurement grids that may be too sparsely 
populated to support accurate interpolation at render time: In addition, with a very large 
number of measurement samples, some measurements may be outliers that are either 
grossly inaccurate, or otherwise not useful for rendering purposes. These problems 
may be addressed by processing the data prior to rendering. Therefore, measurement 
data for a sample may be recorded for later processing, such as by using a computer 
database. 
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Referring again to Fig. 1, at step 106, a set of measurement BRDF data may be 
accessed for processing. Methods for accessing data using a computer system are 
known in the art, and any suitable method may be used. The accessed data should be 
collected and configured as described above. At step 108, a set of measurements may 
5 be processed to provide a table of estimated BRDF values that are sample over a 
denser and/or more regular grid than the actual measured values. The denser and/or 
more regular grid may be more suitable for use in interpolating BRDF values for use in 
rendering. In addition, processing may be used to remove outliers in the data. Further 
details regarding processing of measured data are described below, in connection with 

10 Figs. 3-6. Once the measured data has been processed to provide table of BRDF 
values over the desired grid, the processed table may be stored as indicated at step 
110. Advantageously, the table of estimated BRDF values may be stored in a form 
usable as input to a shading process based on ray-tracing. 

At step 112, a suitable material shading algorithm may access the resampled 

15 BRDF data recorded at step 1 10, and interpolate reflected flux as a function of incident 
angle, reflected angle, incident ray intensity, and a BRDF value interpolated from the 
resampled BRDF data table for the rendered material. A typical double-interpolation 
method is described below in connection with Fig. 7. Detailed algorithms for carrying 
out interpolation, for example, fast quadrilinear interpolation, are well known in the art. 

20 Any suitable interpolation method may be used. The shader may be designed to draw 
upon a library of resampled BRDF data, and therefore may support realistic rendering of 
any suitable material in the library. 

For example, surfaces within a scene to be rendered may be assigned a material 
identification corresponding to a material in a library of BRDF-measured materials. 

25 Every surface in the scene, or less than every surface in the scene, may be assigned a 
material value corresponding to a material in the BRDF library. For example, only 
surfaces at the focal point of a scene may be selected. Surfaces that are not assigned 
may be rendered in any other desired way. The scene may then be rendered using any 
suitable ray-tracing method, as indicated at step 114. In an embodiment of the 
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invention, ray-tracing tools supplied by Mental Ray ™ ( www.mentalrav.com) were used 
to produce final rendering, using a shading tool that was customized to receive the 
resampled BRDF data tables as input, and to perform a fast quadrilinear interpolation 
between adjacent data points of the sampling grid. 
5 Further details of an exemplary processing step 108 are provided below. In brief, 

a suitable processing method 300 as shown in Fig. 3 makes use of commonly-available 
tools for manipulating three-dimensional data. In an initial step 302, a three- 
dimensional curve is fitted to BRDF values over a convenient grid section, such as over 
a constant-azimuth grid line. Prior to curve-fitting, outlying measurements may be 

10 removed. In an embodiment of the invention, a Non-Uniform Rational B-Spline 
(NURBS) curve may be constructed by connecting the measured BRDF values along a 
grid line. Curve-fitting to a NURBS may be implemented using commonly-available 
tools used in digital rendering, for example, Maya™. Other curve-fitting methods may 
also be suitable, and may be used in the alternative to a NURBS curve. Curves may 

15 similarly be constructed for each section, for example, constant-azimuth grid line, of a 
sampling grid. 

The related curves may then be connected to define a NURBS surface, in step 
304. The resulting three-dimensional surface may resemble a chart of the underlying 
measurement data as shown in Fig. 4A, but differs in defining a continuous surface over 

20 the sampling space, representing the measured BRDF data. At step 306, the NURBS 
surface may be used to generated a resampled data table along any desired grid of 0 r , 
<|> r . The resampled grid will generally be more dense and/or more regular that the 
measured sampling grid. For each value of 9 r , <f> r in the grid, an intersection between an 
outgoing ray and the NURBS surface may be calculated. The resampled BRDF value 

25 for that grid point is the BRDF value for the intersection point. For example, if the 
NURBS surface is defined in polar coordinates, the resampled BRDF value may be 
equated or scaled from the polar coordinate "r" of the intersection point. 

Figs. 4A-5B may help to illustrate the steps of method 300. Fig. 4A shows a 
polar-coordinate, three-dimensional graph 400 of BRDF measurement data from a 
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sampling grid for a fixed incident ray. A diagram of the sample 402 appears beneath 
the graph, along with a pair of coordinate axes for the sample plane. The BRDF value 
associated with a particular reflected ray is graphed as a point (r, 0, <|>) in polar 
coordinates, wherein the "r" is the BRDF value and the polar angle coordinates (0, <|>) 
5 are those of the reflected ray. Polar graphs as shown in Fig. 4A are a standard way of 
visualizing BRDF data, and the particular graph shown was produced by commercially- 
available software for the SOC 200 reflectometer. Although this visualization has no 
use in rendering, it may be helpful for understanding a method for processing BRDF 
measurement data according to the invention. 

10 In particular, Fig. 4A shows that a set of measured BRDF values may be thought 

of as comprising a three-dimensional surface in a reflected ray space. Thus, a BRDF 
"surface" may be "sliced" over a section of a sampling grid to yield a curve. Fig. 4B 
shows a hypothetical slice of BRDF measurement data, taken along a vertical plane 404 
through a constant-azimuth grid line 406. Nodes 408 represent sampling points along 

1 5 the azimuth. For illustrative simplicity, sampling points are not shown on the right half of 
the figure. For each of these sampling locations, an associated point 410 may be 
plotted on the slicing plane. Again, plotted points 410 are not shown on the right side of 
the figure for illustrative clarity. The "r" coordinate of the plotted point corresponds to 
the measured BRDF value. A curve, such as a NURBS curve may then be constructed 

20 through the plotted points, as known in the art. 

When a family of such NURBS curves for BRDF measurements taken for a given 
incident ray 502 are combined, a NURBS surface 500, such as shown in Fig. 5A, may 
be constructed. Any reflected ray from the coordinate origin, for example, ray 504, will 
intersect this curve at a point 506. Thus, the surface may be resampled over any 

25 desired grid, with BRDF values for the re-sampling grid estimated from the 
corresponding "r" coordinate of the intersection point. 

A family of such NURBS curves and corresponding resampled BRFD data tables 
may be constructed for each sample, each corresponding to an incident beam angle of 
the reflectometer. For example, Fig. 5B shows a second NURBS curve 510 for a 
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second incident ray 512. The same reflected ray 504 will generally have a different 
intersection point 516 with this surface. The family of NURBS surfaces and associated 
resampled BRDF data tables represent the four-dimensional BRDF function. 

Just as reflected rays may be too sparsely sampled, or too irregularly sampled, 
5 so may incident rays. For more accurate interpolation, the measured BRDF data may 
also be resampled over a denser and/or more regular grid. Fig. 6 shows exemplary 
steps of a method 600 for resampling BRDF measurement data to provide BRDF values 
over a denser and/or more regular grid of incident rays. At an initial step, NURBS 
curves for an inverse BRDF function may be constructed by plotting BRDF values for 

10 different incident rays, for a fixed reflected ray. The BRDF function is inverted, only in 
the sense that the BRDF measurements are plotted as a function of the incident ray for 
a fixed reflected ray, instead of as a function of the reflected ray for a fixed incident ray. 
However, it is not an inverse function in a strict mathematical sense, and merely 
comprises a different representation of the same function. BRDF values for plotting 

15 may be taken from resampled BRDF data tables for the measured incident rays. 

At step 604, a NURBS surface may be constructed from the NURBS curves 
plotted for a given outgoing ray, just as previously described for incident ray. The. 
surface constructed in step 604 represents the BRDF function for a fixed reflected ray, 
as a function of the incident ray. NURBS surfaces may similarly be constructed for 

20 each reflected ray grid point in the resampled data tables. 

At step 606, the incident-ray BRDF surface may be resampled over a denser 
and/or more regular grid of incident rays, to create a resampled data table for the 
"inverse" BRDF function. As indicated at step 608, the foregoing steps 602-606 should 
be repeated for each reflected ray having a grid point. The result is a family of BRDF 

25 values in tables, each table relating a BRDF value to a single reflected ray and a grid of 
incident rays. In combination, such tables represent the measured BRDF function 
resampled over different reflected-ray and incident-ray grids. They may be regarded as 
twice-resampled, being generated by resampling the first set of resampled BRDF data. 
Note that the size of the BRDF tables may grow with each resampling. For example, if 
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a 100x100 grid may be used for measuring, a 100x1000 table may result from a first 
resampling of this data, and a 1000x1000 table may result from a second resampling. 

If properly characterized in a relational database, such twice-resampled data 
tables may be used to determine estimated (resampled) BRDF values for any 
5 combination of the BRDF parameters 9j, fa, 9 r , <t> r in the grid. At step 610, a database 
relating each twice-resampled BRDF value in the data tables to the four parameters of 
the BRDF function may therefore be generated. The resampled BRDF data is now 
ready to be stored for use in any subsequent rendering. Once determined, it need 
never be recalculated. 

10 During ray-tracing and rendering, the resampled data tables may simply be read 

and the BRDF value for a given reflected ray determined by selecting the BRDF value 
associated with the parameter values 9j, fa, 9 r , fa that most closely match a given 
incident and reflected ray. It is preferable, however, to interpolate between adjacent 
parameters to obtain a more accurate BRDF value. Fig. 7 shows exemplary steps for 

15 one suitable method 700 for interpolating resampled BRDF data during a shading 
process. In essence, method 700 comprises a conventional double interpolation. At 
step 702, the parameters 0), <j>i, e r , fa are defined using any suitable ray-tracing method. 
Note that the orientation of the material to be rendered should be specified relative to 
the coordinate system used for ray-tracing, as well as the surface-normal vector. From 

20 this information, the incident and reflected ray parameters may be determined in the 
sample coordinate system. 

At steps 704 and 706, the adjacent grid values of 9j, fa, G r , fa may be determined. 
If a quadrilinear interpolation is used, four corresponding grid points should be identified 
for each incident and reflected ray. For example, for each 9j, there are two adjacent 

25 values 9i, 0 2 such that 9i> 9j > 9 2 . Similarly, there are two adjacent <|> values for each fa. 

The four grid points for this incident ray would therefore be 0i+i, Q^ 2 , 92<t>i, 92<t>2- 

At step 708, a first one of these grid points may be selected for the incident ray. 

At step 710, a BRDF value is interpolated from the resampled BRDF values for the four 

reflected ray grid points, corresponding to the first incident ray grid point. A fast linear 
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interpolation should be sufficiently accurate, although other interpolation methods may 
be used, if desired. The next incident grid point is selected at step 712, and the 
interpolation step 710 is repeated for each incident grid point until an interpolated 
BRDF value has been determined for each incident grid point For example, if four 
5 incident grid points are used, four interpolated BRDF values will be determined, one for 
each incident grid point. At step 714, a final BRDF result may then be interpolated from 
the first set of interpolated values. At step 716, the final result may be applied to 
determine the intensity of the reflected ray. 

The methods of the invention may be performed using any suitable computer 

10 system. Fig, 8 shows a block diagram of a computer system 800, comprising a 
computer 802 connected to a memory 806 containing instructions for performing steps 
of the invention, and to a database 804 containing previously-defined data, such as 
resampled BRDF data or measurement data prior to resampling. Computer 802 may be 
configured to read a removable media 808, on which instructions for performing the 

15 steps of the invention may be encoded. Such instructions may be read and transferred 
to memory 806 for execution by computer 802. The instructions may be written in any 
suitable programming language and encoded for performing steps of a method 
according to the invention, as described above. Suitable computer systems and 
programming languages for processing measurement and image data are well known in 

20 the art. 

Having thus described preferred embodiments of a system and method for 
rendering a digital object using BRDF data, it should be apparent to those skilled in the 
art that certain advantages of the within system have been achieved. In particular, it 
has been demonstrated that photo-realistic rendering results may be obtained using 
25 measured BRDF data, in the demanding production environment for a major motion 
picture. It should also be appreciated that various modifications, adaptations, and 
alternative embodiments thereof may be made within the scope and spirit of the present 
invention, as discussed above. For example, particular methods for resampling BRDF 
data have been described, but the invention would also apply to other methods for 
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resampling BRDF data to provide a readily interpolated data table. BRDF measurement 
data for sample materials may also be gathered using other methods than described. 
The invention is defined by the appended claims. 
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